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ABSTRACT 

It is frequently convenient in data processing to convert analogue 
to digital data for computer assimilation. A convenient method of such 
conversion has been developed and used in the study of correlation detec- 
tion of audio signals corrupted by noise. 

A method to use apriori knowledge of the corrupting noise to increase 
processing gain has been studied. In the case of detection of a sinusoid in 
noise, an additional gain over conventional auto-correlation of up to 14.5 
db has been achieved. 

Finally, a signal source located in an unknown random noise field 
was detected, classified and located in relative bearing by the cross-cor- 


relation of the signals received from two spatially separated sensors. 
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be Introduction. 

During the summer of 1965, the author visited the U.S. Naval Elec-; 
tronics Laboratory, San Diego, for six weeks. The,experience gained there 
suggested several problem areas which would profit from further study. 

It appeared that there was a need to analyZe large quantities of ana- 
logue data collected during various experiments. The volume of the data 
almost precluded "hand" analysis and yet no facilities existed to enable a 
computer to assimilate the data. This facility was also lacking at the U.S.N. 
Postgraduate School Monterey. 

The data collected during these experiments at San Diego was often 
corrupted by unavoidable locally generated noise. It was felt that if more 
could be learned about this self-noise some better method of data extraction 
might be possible. 

One of the most powerful methods of data analysis is the correlation 
technique which may reveal information masked by corrupting noise. These 
techniques have been thoroughly investigated over the past 25 years, anda 
wealth of literature exists on this subject. 

Although continuous time integrations and correlations are possible 
mathematically on known explicit functions, physical data often does not 
fit a known model. In this case approximations to infinite integrals etc., 
must be made using either analogue or digital equipment. Analogue equip- 
ment tends to be limited in versatility and is expensive, while if a general 


purpose digital computer is available, it can be made to simulate the physical 
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situation. Therefore attention was directed toward describing the analogue 
data by a digital computer. The use of a digital computer to compute various 
correlation functions is the subject of this report. 
Eg Statement of the Problem. 
The correlation function of two continuous time variables is given by 
T/2 
Rg4n(T) =UM + fs) +7) at (1) 
T->-a> -T/2 
where s(t), N(t) are defined for -w <t< ~@ 

When the functional form of s(t) and N(t) are known it may be possible 
to evaluate Eq. (1)mathematically. When the form of s(t) and N(t) are known 
only as analogue signals Eq.(1) may be instrumented by a multiplier and an 
—— 

The same effect may be achieved by digital means, subject to errors to 
be discussed. 

The sampling theorem states that a continuous function can be repre- 
sented ina finite interval by a finite number of samples of the function. The 
rate of sampling must exceed twice the highest frequency component of the 
Fourier transform (spectrum) of the function. 

By suitably band-limiting a function, samples may be taken at a prac- 
tical rate. The samples if digitally described can then be processed. Equa- 
tion (1) implies a memory extending into the infinite past which cannot be 
achieved physically. As an approximation the "short-time" correlation may 


be formed with some resulting error. 
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If the "short-time" correlation is formed digitally, errors arise from 
both the limited number of samples and by the finite accuracy of the indivi- 
dual samples. If "short-time" is defined to be some period much longer than 
the period of the lowest frequency in the signal, errors of the first kind above 
tend to zero as the length of record grows. Measurement error is negligible - 
if the samples are described to four place accuracy. 


The “short-time" correlation is formed as 


N-K 
Rewkan = whe > sf NAY (2) 
i=] 
where 
AT - the sampling interval 
s; ; N# = sample values of the continuous functiontaken at 


intervals of T 
km a, lypwBeoes oul 
N = the number of samples available. 


In the limit as N goes toeo , andAT ~+>0 


A 


Roxy yx (KAT) = Roi (T) (3) 
For finite N 
Rewyy#(ke Das Ron (7%) (4) 
Equation (2) holds only if the data has zero mean. If in Eq. (1) we 
assume that s(t) is the desired signal, of zero mean and that N(t) is random 
Gaussian noise and that the observed V(t) ~ + N(t), then we may form 


Ryy(T). This function may in tum be broken down into components: 


1S 


Ryy(T) = Rog(T) + Ryn ( ipa Ron (1) (5) 
Since the noise and signal are assumed independent the third number 
vanishes in the limit T3~<. 
We may approximate Eq. (5) as 
~ Nn A 
Roapyx (KOT) = Rgage(kAT) + Ryne (kT) (6) 
in which we wish to determine Roxge(kOT). 
For very large k = Kg the second member of Eq. (6) will tend toward 


zero because of independence leaving 


A A 
Roapnx(Ky + JA Te Rgxgx(K, + JAT (7) 


j — O, l, Zn e@ee¢e -J 
This restriction is not desirable = since if Ry ey (kK 41) were Known for 
all k, then in Eq. (6) 
~ A aw 
Roxga(kAT) = Roayye(kKAT) - Ryanye(k 4T) (8) 
However Ryxyjx(k4T) is never known exactly. It can only be known, 
since it is a random variable, in an average sense. 
If we assume that the normalized correlation function Run (kAT) is 
known apriori 
Ryn (kaT) = = RNiN (KAT) (9) 
where Ryn (ka T) is formed in the absence of signal 
&% is to be determined where0S & S 1 
then in Eq. (8) we may write 
Aw JOA ‘ ae 
Roxga(KAT) = RoxynxdkAT) - O& Ry (kT) 


Methods of determining @ have been studied for the very limited case 
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of a single s#nusoid signal masked by noise. 

To gain some experience with the technique of.cross-correlation, a 
low level signal was placed in a noise field. The output of two spatially 
separated sensors was processed to detect and locate the signal. The re- 
sults are presented in section 5. 

3. Conversion of Analogue Signals to Digital Form for Computer Analysis. 

a analyses of real data may be performed on a digital computer by 
first manually sampling the data a sufficient number of times, and entering 
the sampled data into the computer. 

When.the number of data samples desired exceeds a few thousand, some 
automatic means of data conversion must be used. 

The method should preferably be "off-line, " that is, use auxiliary 
equipment, for efficient employment of the main high speed computer. The 
Computer Laboratory of the Electrical Engineering Department was equipped 
with the necessary items of hardware and these facilities were used to sample 
the analog data and form the digital record. 

The three main items used were a 12 bit analogue to digital convertor 
a Control Data Corporation (C. D.C.) Model 160 Computer having a capacity 
of 4096, 12 bit words, anda ©.D.C. Model 163 magnetic tape unit. 

As now constituted the analogue data is consecutively sampled by the 
analogue to digital converter working under control of the CDC 160 computer. 

When 4000 samples have been taken, the computer writes the samples 


on magnetic tape in a format that is recognized by the main CDC 1604 comr 
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puter. After a delay of 0.4 second another 4000 samples may be collected, 
and soon. Each group of 4000 samples when written on tape is accompanied 
by an identifying word so that any block of 4000 samples may later be located. 

The maximum sampling rate is 5 Kcs. implying that all signals shopild be 
band-limited to less than 2500 cps. The sampling rate may be varied at will 
by manual program entries, as can other convenient parameters. 

The system is capable of digitizing only one source ata time. To allow 
cross-correlation of two or more sources, a clock pulse input is used to in- 
itiate a round of sampling. 

At present a simple AND gate is used to sense-the presence of a clock 
pulse. A more permanent arrangement should make provision for the detection 
of a simple clock code, to eliminate the occasional false starts due to noise 
pulses, which have occured under present arrangements. 

Once the data has been recorded digitally on tape, the data may be 
read into the main computer using standard programming techniques. The 
subroutines to accomplish this are available as Subroutine Data from the 
Computer Facility. 

The data when read into the computer is delivered in integer format, 
i.e., without a decimal, To convert it to units of volts each data point is 
then divided by 409.6, a factor inherent in the particular A/D converter used. 


The diagram below shows the essential steps. 
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Figure 1. Flow Diagram of Digitizing Process. 


The system is presently adequate to describe many physical processes. 
Certain signals, such as speeah, are beyond the capabilities of the system. 
However modifications to the Computer Laboratory hardware to improve per- 
formance were not attempted because of pending contractual arrangements to 
completely replace the hardware with more sophisticated equipment. The new 
equipment will enable two records to be digitized simultaneously. The memory 
capacity will be increased by nearly a factor of four, and the sampling rate 
will be approximately 20 Kcs. This equipment willbe available for use in 


mid 1967. 
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The author has recorded the mixed output of a signal and a noise gen- 
erator to provide a vehicle for the study of correlation. Several other students 
fs 6], 7 | have used the system for their own particular needs with no difficulty 
experienced to date. Additional details on the digiting process are presented 
in Appendix A. 
4. Noise Removal in Auto-Correlation. 

Correlation techniques have gained considerable favour in recent years 
as a method of signal enhancement. Theoretical derivations of the processing 
gain to be expected have been stated by Lee[ | a for both auto and cross- 


correlation. 


Auto and cross-correlation are defined as follows: 


, D2 
R3(T) = lim — am V(t). Vit +T) dt (1) 
Tyo I -T/2 
where V(t) = s(t) + N(t) 
s(t) = the signal to be recovered 
N(t) = noise;. here assumed Gaussian 
277 
Ro(T) = lim — asi V(t). st(t +7) at (2) 
i i cma -T/2 
where sl(t) is chosen apriori to have the form of s(t) and is locally 
generated. 


Approximations to Eq. (1) and (2) may be generated using sampled 


data in which case. 


l A 
R(T) = a 1 mee iin te), 


oo 


= R(T) (3) 


a 


20 


Ro(T) = = 


nM 2 


V4 (i). - Vo (i +'T.) ot R(T) 
1 


A (4) 
i 

IN 

where V; = V(t) fort = iat 

It may be shown that Eq. (3) and (4) are of the form 

A A fh “ A 
R(T) = Regi) + RynT) + RoylT) + Byg(7) (5) 
S 


Of the four terms in Eq. (5) it is desired to determine only the first, 
Ree (T. ) which represents the signal contribution. The remaining terms are 


undersirable and success is measured by the extent to which they can be 


eliminated. 


A A 
The cross~-terms Row Rnis will vanish as N-~»-%, because of the as- 


sumed independence of the signal and the noise. 


Since the correlation is to be done using a finite number N of samples, 
these terms will become small, but may be significant. 
Let us assume that a signalis of the form 


s(t) = Y2 Ecos wt 


N(t) = Gaussian noise of zero mean and variance on 


The variance of the output of Eq. (3) and (4) has been evaluated by 


Lee [i], who clearly shows the superiority of cross-correlation over auto 
correlation. 


In the case of auto-correlation 


2° Ew 4 
Oc TE OG (6) 
while for cross-correlation 
eZ, — Ea Si. nd re 


Ze 


This improvement is achieved only when the form of the desired signal 
is known apriori. In many cases of interest particularly in the passive sonar 
situation, the desired signal form is not known apriori, and consequently 
auto-correlation must be used. 

In addition to the noise input supplied by the environment, local dis- 
turbances may cause noise effects to appear as part of the correlator output. 
If these two sources of mise, taken together, are Known apriori, and can be 
considered to remain stationary over the interval under consideration, then 
perhaps some means can be found to eliminate their corrupting effect on the 
output of the auto-correlator. 

This problem has been studied for many years. In an early work 
Lee [4] states 

"...the correlation of the noise, once measured 
can be compensated. (for)" 

The details of the implementation of this were not specified. 

In a much more recent work Van Trees [3] considers an optimum 
receiver in which he considers that the noise is known apriori as a norm- 
alized correlation ¥ (7). After correlation of the received data some 
constant K times Y (7) is substracted form the correlator output. Deter- 


mination of K rests upon knowledge of signal strength and noise strength. 
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Again it is not clear how to instrument the calculation of K. 

We will assume that the sample auto-correlation of the signal, 
Roan (T) has been formed in the presence of corrupting noise. We shall also 
assume that the statistics of the corrupting noise are known apriori and are 
represented by the normalized correlation function Ry ) formed in the 
absence of signal. 

The object of the processing is to seve nme a linear combination of 
Roan (V ) and Ryn) which will enhance the signal and tend to remove the 
noise. No claims are made for the optimality of the method presented here, 
other thanit does improve the signal to noise ratio of the output. 

In the following we will be dealing with sampled data functions, not 
continuous functions of time. To simplify notation however the symbol VY 
will be used to denote a sample data function. 

The power spectral density P(w), and the auto-correlation functions 


are transform pairs, thatis 


R(T) =f Plw) eiWT aw (3) 
P(w) = i nf R(T ) eIWT gy (9) 


Given one member of the pair, the other may be found. Therefore the 
processor could attempt to operate on either the power spectral density or 


the correlation function. 


From Eq. (5) we get (neglecting cross terms), 
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IN AN A 

Rog(T) = Roy y(T) - Ryy(T) (10) 
or equivalently by Eq. (9) 

Pog(w) = Poin lw) - Py (w) (11) 

We have assumed that as apriori information estimates of the norm- 

alized power spectral density function Prony (w) and normalized auto-correla- 
tion function Runt) , formed in the absence of signal, are available. At 
any given instant there is no assurance that the apriori known noise estimate 
represents the true noise in other than an expected Sue sense. 


Then in Eq. (10) and (11) we may write 


Rgg(T) = Rg+n(1) - & RNN(T) (12) 

Pog(w) = Poaun(w) - & Pyyy(w) (13) 
where Ryn (T ) and Pr (w) are known functions 

OK<ax € | ,e& a constant to be determined. 


Determination of the &% in Eq. (12) and (13) becomes the central 
problem to be considered. 

The following methods of calculating as hold only for the case of sin- 
usoidal signals in noise. Further study is necessary before any general 
method can be stated. 

Since the correlation function was produced from the data directly and 
the power spectral density indirectly from the data via the correlation, it was 
thought advisable to operate first on Eq. (12) rather than Eq. (13). 


In the case of a sinusoidal signal, it was thought that finding an 
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oN = Ac, such that Reg (0) % Max Roc(7 ) (14) 
fie. 2 


would be advisable. 

However Eq. (14) is only a necessary not a sufficient condition for 
the formation of a valid, physically realizable auto-correlation function. 

Thus an instrumentation of Eq. (12) to satisfy Eq. (14) may result in 
a correlation function which is the output of a physically unrealizable linear 
system. In the time domain there seem to be no simple tests for realizabi- 
LILY. 

Several signals were analyzed using Eq. (12) and (14) at input signal 
to noise ratios of 0 and -l10 db. No trouble was experienced with the 0 db 
case; the signal was almost completely recovered and the noise suppressed. 
The -10 db input signal after similar processing was transformed into the 
frequency domain. The signal was clearly evidenced by a large spike in the 
power spectral density at the signal frequency. The amplitude of the signal 
spike after processing showed nearly 6 db greater discrimination between 
signal and noise peaks than it did before processing. 

The above gain would have been encouraging had not the ‘power spect- 
ral density! showed some negative contributions. 

Negative contributions in a power spectral density, are evidence of, and 
in fact are a sufficient condition for, physical unrealizability. 

Because of this difficulty no further efforts were made to. suitably deter- 
mine os on the basis of the correlation functions. Efforts were then directed 


to a determination via Eq. (13). 
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If the signal is a pure sinusoid with no noise present, the power 
spectral density shows a delta-function of (w) at w = wo, and is identically 
zero for all other values of w. The perfect processor would give this output 
even in the presence of noise. 

There are two conditions one may then place on Eq. (13). These are 

(a) There must be no negative contributions 0< wSw . ... 
Max 

(b) At least one point must be zero. 

This allows an <a to be determined directly in the frequency domain. 
Condition.:(a) above ensures realizability, while (b) ensures that for any 

A~7%_, condition (a) is violated. On the other hand choice of an 
A<*. results in the removal of less noise than one might achieve other- 
wise, but at least ensures physical realizability. 

A trial and error search routine was carried out to find an ~% which 
satisfies conditions (a) and (b) above. The search routine is halted when 
ane is found which results in at least one point of Eq. (13)having a value 
€, 0£€ € .00001, and no negative points. The time to complete a search 
is in the order of .5 seconds, which is small compared to the time taken to 
form the functions originally (70 seconds). 

Having formed Poo ( w) ime Eq: (13) - results were renormalized to make 
the area under the curve unity, and then plotted. 

The =S. determined by a search was then used in Eq. (12) to form 
Rog (T) and the result plotted. No claims for validity are made for this step 


except that having formed Rog (T) in this manner.its transform had no negative — 
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components. 

The noise removal proceedure based on an « determined from the 
power spectral density resulted in an additional 14.5 db processing gain. 
This figure was obtained by considering the ratio of energy under the 50 cps. 
comb-width to the total energy under all other comb-widths, both before and 
after the noise removal. Before noise removal the calculated input signal- 
to-noise ratio was ~8.84 db. . After noise removal the equivalent calculation 
yielded + 5.62 db. 

Another measure of effectiveness should be mentioned. In many cases 
the ability to distinguish a signal from . noise in the spectral density is of 
interest. In the power spectrum the ratio of the amplitude due to signal to 
that due toa noise "spike", may be expressed in db. In the -8.84 db 
(nominally -10 db) case, the ratio of signal to highest noise peak was 5.62 
db. before noise removal, and 9.05 db. after noise removal, or an improve- 
ment of 3.4 db. 

Details of the processing are included as Appendix B. 

Si Location of a Source by Cross-Correlation. 

The bearing of a signal with respect to an abserver may be determined 
by measuring the difference in arrival time of the signal at two or more sep- 
arated observation stations. 

As an experiment a 200 cps. sinusoidal signal generator was set in 
one corner of a cafeteria. Two microphones spaced a distance d units apart 
were located symmetrically with respect to the center line of the room, at 


the far wall of the cafeteria. Interfering noise was supplied by the noon-day 


oe 


clientele. 

The maximum level of signal was limited by the intolerance of the din- 
ers. This was determined to be’ 38 milli-watts measured at the loudspeaker 
voice-coil. At this level the signal was inaudible at the microphones. 

A stereo recording was made of the signal plus noise, and after slow- 
ing the tape by a factor of four, selected portions of data were digitized 
using techniques detailed in Appendix A. The resulting digital data was 
cross-correlated in the CDC 1604 computer and the correlation function plot- 
ted. 

The geometry of the problem is shown below. 


| Source 


NOISE FIELD 


| 


| 


y 10.15. 





Figures2< Geometry of Lunch-room Problem. 


Assuming plane wave propagation, and in the absence of noise, we 


may associate with A D in Figure 1, an equivalent amount of time; that is, 
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AT = AD/C where C is the velocity of sound in air. 

If the two sensors are cross-correlated a maximum in the function will 
occur whenever the time variable of Correlation is equal toa multiple of the 
period of. the signal. 

The signal was located successfully to an accuracy of + 0.17%. The 
frequency of the observed correlation function was nearly 150 cps., or three 
times the expected value of 50 cps. This would indicate that detection was 
accomplished on the third harmonic of the source oscillator. 

A study of the noise characteristics supplied by the diners was not 
made. 

Provided that accurate time synchronization between the two data 
sources to be correlated can be maintained during the digitizing process, 
correlation will provide both bearing and frequency information. 

Details of the problem are presented as Appendix C. 

6. Conclusion. 

A convenient method of digitizing analogue data has been developed 
and this digital data used to detect signals masked by noise. 

The digitizing system is now operational. 

Many interesting areas of research remain to be pursued in the field 
of recovery of noisy signals. In particular additional effort is needed in the 
area of removal of apriori known noise effects. 

The facilities to perform the necessary calculation on a digital computer 


are now available at the U.S. Naval Postgraduate School. 
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APPENDIX A. 


ANALOGUE TO DIGITAL DATA CONVERSION 


hg INTRODUCTION. 

The process of translating real, analogue data into computer digitized 
form has been accomplished in two separate stages. 

In the first stage, the analogue data on magnetic tape is sampled at 
Here points of time. These samples are digitized and written in bit form 
on magnetic tape. 

In the second stage, the digital magnetic tape is loaded on the CDO 
1604 peripheral tape units and then read into the computer. 

Earlier work at USNPG School in computer analysis of analogue data 
utilized the “on line" approach, in which the data was fed to the main com- 
puter directly from the digitizing computer. This mode of operation is now 
impractical because of high computer facility utilization. 

The method detailed here results in data being reduced to a form suit- 
able for submission as a standard program input. 

Jap DIGITIZING THE DATA. 

Basically the method takes samples until the Core storage of the dig- 
itizing computer is full, and then writes this information on magnetic tape 
in digital form. 

The digitizing computer is a CDC 160 located in the Computer Labor- 
otory of the Electrical Engineering Department. 

This computer has a 4096, 12 bit memory length, and has the ability 


to select various external equipments through the proper external function 
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codes. The lower 4000 cells of the computer were reserved for data storage 
and the top 96 cells for programming. Thus the core storage available sets 
one quite restrictive limitation on the system. In practice however, 4000 
samples were adequate to describe many common processes. 

The block diagram of the system is shown in Figure 1. The 160 selects 
either the A/D converter, for data input, or the 163 tape unit for data output. 
When the A/D converter is selected (EXF 14xx) and the INA (INput to A) in- 
struction is executed, the input analogue signal. is sampled, anda 12 bit 
number representing amplitude is sent to the 160 and stored. Repetition of 
the process in quick succession allows blocks of up to 4000 samples to be 
stored. The maximum sampling rate achievable is 5000 samples/second. 

To control exactly the time at which samples are taken, the execution 
of the INA instruction is prevented until two events have occurred; first, an 
enabling switch must be closed to ground (EXF:2410), and second, a pulse 
(see Figure 2) must be present at the base of the AND Gate. When these 
conditions have been satisfied the flip-flop goes to the "1" state placing -3 
volts on the INA line and thus executing the INA instruction. 

Further samples may now be taken as the flip-flop will stay in the "1" 
state until EXF 2400 is called, resetting FFl to the "0" state. The complete 
process is illustrated in Figure 3. 

The usual mode of operation is to have each block initiated by a pulse, 
with the intersample delay under computer control. Under certain circumstan- 


ces, it may be desired to have only the runs initiated by a pulse, with both 
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the block count and the sample count under computer control. 

The inter-block timing in this mode is not accurate enough for cross- 
correlation. The basic program shown in Table 1 may be modified using 
Table 2 to give various modes of operation. 

Operating Instructions-Digitize Eq. (3). 

Features of Digitize Eq. (3). 
1. Manual Entries 

a. 0066 - intersample delay. See Figure 6 

b. 0067 - any identifier you wish 

c. 0070 - initial run number 

d. 0071 - number of runs desired 

e. 0072 - number of samples/block <= 7640, = (4000), 4 

f. 0073 - number of blocks/run 
Note that (d) x (f) = 760, 

2. Main Points 

a. A block ofn, n < 4000, 4 samples is taken each time a clock 
pulse is present and EXF 2410 is made. 

b. The inter-sample spacing interval is program controlled and is 
variable from approx. 190 fAsec. minimum to about 50 msec. maxi- . 
mum. 

c. The first four (4) words written on the 163, of each block, are 
identifying words in the following order: 


(1). Run number. 
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(2). Spare (may be preset to anything) 

(3). Block number 

(4). Number blocks/run 

The identifying information when digitizing data must be recorded, 
as 1604 subroutine DATA uses this information to locate blocks of 
data on digital tape. 

At the end of each run a check is made to ensure that the storage 
capacity of a full roll of 163 tape is not being exceeded. If it is, 
an End of File is written and the program halts with the total numb- 
er of blocks written in the A register. 

Program may be stopped at any point to allow cueing data tape, 
provided that it is not cleared. Progress resumes when 160 placed 
in run condition. 

Analogue. input is at A/D Channel 1. A voltage reference is est- 
ablished by an external source at about -5 volts. Correct opera- 
tion is assured if the proper test pattern is displayed. See in- 
structions for Program Test 160. 

A voltage of V volts at A/D Channel 1 is converted to a digital 


reading by the A/D converter, equal to -409.6 x V 


Operating Instructions 


Load from cell 0000 
Run from cell 0000 


When digitizing is complete program stops at 0124 with current 


run number in A register. 


39 











(2G 
tao 
COMPUTER 


7 | mm | AS» | 


; f 

} " MONITOR} t 

: r a ‘eet 

1 diay | {VOCMVERT ER wen 
' j ~ INA hee eee 














(ey ee 
§ GENERATOR, 







Figure i- Blot DIAGRAM OF DIGITIZING HARDWARE. 


ce tot ico fas : 
- SUPUT CLOCK PULSE TO 
alli PE RECCROTR 





| 
' 
| | 
| 
{ 


| * 
| = | 
or OUTPUT CLOCK PULSE 


OO Cree ree eptr, » = 
eo PE menor ernment yl lta ate 
bi 
+ 


| ¢ 


AFTER SAT UR AT IOR 
ATUL EFI T ton 


—p AFTER REGENERATION 





i= 100 MS. al | [ 


Figuae (a C Lec PULSE DEVELOP Mes 


; 


36 


} 








r 7 See ER Ce ae ee ae eR ee eee | ET eee ee 
nN | 
| <i a 
=. pre nop Ned a Var s Sih oat, arte A cs Ae Pm Ada fre ot SUI. enn BE NaN eth wig - Oeste be. ON rete DATA | RAG iS { (A) 
a 4 | | 
a ; : Se anal / Cae 
y ¢ eomaiaert * aS =r ea aw. G4 aha et, pr een Bice ptm + me foi on- Ce ae DM Neen fe a> wie wh nO conan, Pwd DAT Fy TRACK a (8) 


> 

a 

Ps 

; Be 

T= 
—--—- % DATA TRACK 
: . S CLOCK TRACK 





Exparcep ANALOGUE Tape SecTION | 


Ne ge tng eee te, wnt calla ae) Sie 


Ate rene # hy, 
_ ae rt Nan pe gee et EB nae” Re ps ae: ~ ence cael mani 


mom on ——— 





~ ' 
| namics a | 


ee | een 
| PROGRAM SHUFFLE 160 ae 


q 


\Z 
t 
re- ORDERED Dis ITAL Wes PE 


ANE cae oar 
YY) % 
ee < 


aaa 
| 
i 
ae 

















fue DieirizinG Rocess 


37. 








lee 
h--Zwe ozkeo+ zona 
an - ae saineties Soemienntncncemtaeen cere 
ms G 
$ - 9 g 3 & ¢ “a 8 : Q 
5 o 


oe ANA ID ae BOW aS etee Se ae ae Powwow: 


e. 


3 


2 


? 


2) 


as 


aq 





Oo 10 


+ 


pi 


22 2-4 


V2 6S UB S20 


1.0 
M—SeG 


Figure 6 


TimncR Conteot wors V3. SAmPLNG INTERVAL 


2Q 





MAA 


i 7 gal 





250 50D 8D {ke LAS LS Ets 2.0 2Aa5 aS 
SHANNON FREQUENCY cs. 


ro 9 
Ss m= ONTER-SAMPC DELAY & NUMBER Sampues / BLocK \oO a 


GS 
Uj] A 
ip 
2) 

| 


TIINTER-SANFRE DELAY * NUMBER sAmPLED/ BLK 3 


rr URE 


G\ 


-~) 
© 


VU) G 
© Q 
cent onnmeenf in nn fn 
a ass 


 0\5 
N ¢ 
U 
ae 
ae sacra 
S | 
a) “ 
Se . ) 
ee a ee 





oS 1.0 mira 2.9 At 
SHANNON FREGUENCY Kos, 


(63 Nasnenctaee cAPAcItTy VS. FREedVENcy 


38 


d. Clear and run from cell 0127 to write E. Oy, ie 


4. Modification. 


~ oe 


a. See Table II for various possible modifications. 

The limitations of the sampling process are graphed in Figures 4 and 5. 
Figure 4 shows the effect of sampling speed on the percentage of the data 
that may be digitized. The speed of the data gathering is a variable under 
program control, while the speed of output is not. is at slower sampling 
rates, the sampling approaches continuous sampling, and the amount of the 
real time data which may be represented on tape, increases, as seen in 
Figure 5. 

Figure 6 shows the redationship between the number entered as inter- 
sample delay timing word, and the resultant inter-sample delay. 

The development of a clock pulse from initial, recording to output at 
the flip-flop is shown in Figure 2. Experiment has shown that a total delay 
of 100 micro-seconds exists between t,, the time of initiating the pulse on 
record and t;, the time the pulse is delivered. This,period remains station- 
ary over a large range of level settings, pulse widths and amplifier gain 
settings. Thus the clock pulse may be used to synchronize two pieces-of data, 
as in cross-correlation. 

Experience has shown that since only the first of a series of adjacent 
clock pulses in used to initiate sampling, the recording of a train of pulses, 
rather than a single pulse is a great aid in cueing the analogue tape. The 
length of the train must be less than the length of time taken to sample one 


block. 
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In order to set the CDC 160 up properly for digitizing, a short program, 
TEST 160, has been devised (see Table III). In this program, the first cells 
-0000 to 0017, contain a program to accurately set the bias voltage. With 
no signal in and the bias at -5.0 volts, the value of the conversion should 
be 0000 or 7777. By monitoring D/A Channel 1 witha "scope", deviations 
from the zero condition may be detected and adjusted using the voltage con- 
trol on the bias source. Small errors in zeroing abe expected, due to line 
drift, etc. The effect of this may be eliminated by removing the mean of the 
data in the 1604. 

The cells from 0020 to 0045 contain a program which has identical 
timing to that of DIGITIZE. By observing the input request pulses on the 
patch box, between the CDC 160 and the A/D converter, one may adjust the 
value of the timing control to give the desired inter-sample delay. Chang- 
ing the control word by one number changes the sampling interval by 12.8 
microseconds. 

In order to distinctly label each block of data written on digital tape, 
an’ identifying series of numbers is first written, followed by the data points. 
Since it takes four CDC 160 words to equal one 1604 word, it was convenient 
to specify four quantities in the identifier. 

1. Current run number-indexes once a run 

2. Spare-may be sefit to anything 

3. Ourrent block number in the run 


4. The number of blocks per run 
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Por example, at the 5th run, using two blocks per run, and the “spare” 
set at 4321, the identifiers would appear in the 1604 as: 


0005 4321 0001 0002 
0005 4321 0002 0002 


Precise records must be kept of the identifiers when digitizing data, 
as data location on tape is by means of these identifiers. 
3. DATA RECALL 

The data in digital form may be recalled by calling Subroutine DATA. 
S/R DATA in tum utilizes two subroutines, FINDIT, which locates the data on 
tape, and UNPACK, a machine language routine which unpacks the samples. 
The result is to create the original CDC 160 sample list, word for word'in 
the 1604. 

The unpacked data is presented to the main program in integer format 
and appears in either KDATA (M, 1) or KDATA (M, 2) as: specified by KLIST. 

Integer format output was chosen for the sake of generality as this is 
the format of the raw unpacked data. 

Normal use is to change the data to floating point format, remove the 
mean, and divide all readings:bya factor of -409.6. The letter factor converts . 
all readings to volts. 

When reading the tape on the CDC 1604, it is convenient to have the 
blocks arranged sequentially on tape to prevent tape rewinding and scanning. 
However, when digitizing data for cross-correlation, it is convenient to 
digitize all the right channel information, and then the left. 


bad 


Since it was desired to cross-correlate the left with the right channel, 
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some reordering of data at tape was necessary. Program SHUFFLE does this, 
reordering ie data so that the output appears as right samples, left samples, 
right samples, etc., in consecutive order. 

once the data has been written on tape in the order that it will be re- 
called, the average time taken to recall one block, unpack it, remove the 
mean, and convert it to floating point form is less than 2.75 seconds. 
4, TESTING THE SYSTEM 

In order to test the capabilities of the digitizing system, a test tape 


was prepared with two blocks per run, and each block of 4000 samples on 


each of six known signals. 


Run signal Identifiers 

1 8.0v. peak-peak, 250 cps 0001 0000 0001 0002 
square wave 0001 0000 0002 0002 

2 5.0 volt, 250 cps 0002 0000 0001 0002 
Triangular wave 0002 0000 0002 0002 

3 6 volt, 250 cps sine 0003 0000 0001 0002 
wave 0003 0000 0002 0002 

4 -~8 volts DC. 0004 0000 90001 0002 
(-3 below reference) 0004 0000 0002 0002 

5 20 cps band-limited 0005 0000 0001 0002 
white noise, 7.07 0005 0000 0002 0002 
volts rms. 

6 White noise 7.07 volts 0006 0000 0001 0002 
rms. 0005 0000 9002 0002 


The data was analyzed by Program TEST and the resulting analysis is 


tabulated in Table IV. The data was recorded on Reserve Tape 18. 
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Table IV. Summary of Test Results. 











R Signal T pMEAN7EXP — PS? fc/EXP 
ee ee 
] Soquare Wave 290 cps 0/-.132 16/16.365 --- 
2 Triangular 250 cps 0/+. 086 2.0/2.09 = 
3 Sine Wave 250 cps OY +O? 4.5/4. 56 --- 
4-8 Volts D.C. =3/=6005) 40.0/4874x10°° =e 
5 20 cps White Bandlimited 0/+. 147 -/2.10 20/29.5 
Noise cps 
6 White Noise 0/-. 094 -/2.2 200/199 
cps 





Mean Recovery Time Per Block < 2.75 Secs. 
Digitizing Noise is 63 db Below a 3 Volt Signal 


Do ERROR. ANALYSIS 


In the analysis of the data it was desired to determine an estimate of 


_ 
o2, the data second moment, and to determine a confidence interval on the 
estimator. 
It has been shown [2] that: 
N 


s4 = : | = (XX; - x2 | , is an unbiased estimator 
i=l 





t 
for 6¢ 52 may be conveniently calculated by: 


N N 
ae = ] | 2x2 _ xX 2 x, | 
ie % : 





N - 1 om 


To obtain an estimate of the confidence we may place on s2, we assume 


that in the large sample case, as here, the distribution of s* is normal in 


SORA ow ane - 
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4 4. 


which case: 
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is the value of the standard normal r.v. which will have a proba- 


4 ——74 ) 
Var(s2) = Oo , pr| 182 - 421 | <. k ! 


\e 


where k 
bility of being exceeded of 8. 


The confidence interval here was chosen to be 99% or .99 which implies 


Kg = 2.97 


ie. a } (0,2) < 2.57 | = 0.99 


Thus the confidence range C was constructed: 


——1——_ } 

aac ataaa 
k | <i a 
6B} N-l 


C indicates the region about s2 in which one has a probabilily greater 


C = s4(l - 


than .99 of finding the true&2. 


If we form C/s2 we have 


k 
yr X 100% = cs 


X 100% 
l+k Ls i 


E 2.57, N = 3900 and hence C/s2 = 


In the data analysed here kK = 


9.42%. 


This means that we are confident that the true 2 will lie within 5.4% 


of the estimated 62 = 52 with probability .99. 


Note that lim® Ge _ k 
N->A 52 b 
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In each of the runs it was desired to plot both the signal and its' auto- 
correlation function. The units of the signal are converteditovolts by divid- 
ing all data samples by 409.6 or 2048 levels 

5 volts 

Sine, square, and triangular waves were analysed to check the scal- 
ing accuracy. It was found that the accuracy of measurements exceeded 
that of the oscilloscope used to measure the input. waves. 

The D.C. signal was analysed to observe the amount of digitizing 


noise and hum introduced by the process. 


The maximum change in the digitized level was about 4 numbers or 
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7048 X 100% = 0.2% of the full scale. Over the period of 0.8 seconds 


the mean square power was 4.74 x 107° watts and the rms. voltage was 
2.17 x 1073 volts. (A change of one number -2. 44 m volts) 

Thus for a 3.025 volt signal, the noise and hum is 62.8 db below the 
signal. 

The presence of a strong secondary peak in R(T ) at T = 1/6oth sec., 
indicates the presence of a strong 60 cps component.in the noise. Assuming 
that at T = = sec. the noise is uncorrelated, then R(1/60) = 2 x 1076 or 
66.6 db. with respect to a 3.025 volt signal. Thus the digitizing noise is 
3.3 db stronger than the hum. If hum could be completely eliminated, the 
noise power would then be -63.3 db below a 3.025 signal or -53.7 db below 
) watt. 

The “wHite” noise and the band-limited white noise samples were 


taken primarily to check the whiteness of the noise generator. Measurement 
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of the a point of the R(T) curve indicates the generator output would be flat 
within 3 db out to 200 cps. 

A considerable discrepancy between the rms voltage as measured with 
a VIVM, and the calculated value of R(0) and sé, was observed. Some of 
the error is due to the motion of the needle, and some due to the fact that 
the averaging time of the meter was about twice that of the correlater. How- 
ever the most signifigant factor was a faulty measurement probe. 

6. RECOMMENDATIONS 

No attempt was made to "fix" the installation, and hence some prob- 
lems arose that would not have occurred in a permanent installation. 

Noise and hum reduction was only achieved by careful grounding and 
the use of BNC type coaxial signal leads. The use of coaxial cable is re- 
commended for all digitizing work, for the above reason. 

A clock pulse was used to synchronize left and right channel data. 
Unfortunately, the act of switching Ampex tape recorders on or off in the 
record mode causes transients to be generated on all tracks. Thisisa 
characteristic observed on both the Ampex CP100 unit of E.E. department 
and the Ampex FR-100 unit of the Aeronautical Engineering Department. 

The transient pulses may be treated as clock pulses by the program, 
causing loss of channel time synchronization. 

The problem was partially overcome by removing the output of the 
pulse generator until the transients were past. This is satisfactory unless 


the first clock pulse is close to the transients. A standard interval of 20 


A7 


seconds is recommended between the start of data and the first clock pulse, 
as a temporary restriction pending hardware modifications. 

A more permanent solution would be to imcorporate a time delay in all 
record channels of the Ampex CP100 to allow transients to die out, when 
starting and stopping the unit, before energizing the amplifiers. This should 
prevent spurious clock pulses from being formed. 

Despite great care, occasional spurious pulses appear on the clock 
channel, and may cause false sampling to take place. The use of the short 
optimal length pseudo-random code as a clock aaa together with a match- 
ed receiving filter would correct this problem. 

The system as implemented has a 2.5 Ke upper frequency and 4000 
samples continous sampling capability. Since at best, samples may be taken 
every 190 jxsecs., of which only about 50 jAsecs. are chargeable to the A/D 
converter, the most likely place to begin the search for higher sampling rates 
is in the computer itself, rather than in a more expensive A/D converter. By 
deleting certain functions from program DIGITIZE, the sampling may be made 


faster but in no case is it possible to sample at intervals smaller than about 


100 secs. 
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Table I(a). Program Digitize. 


ee TS NE SES SY SR SG ne RS SY I Qe a ee eee ee ee 








Cell Contents Code Explanations | 
0000 0101 PTA 
IL 0603 ADNO3 ' 
2 7064 JPI64 Jump to INITIAL., 
3 7500 EXE00 ’ 
4 2410 2410 Set Enable 
5 7500 EXF 00 
6 1401 1401 Call A/D Channel 1 
| Zz 7600 INA INPUT 
0010 4176 STI76 Store sample in-(0076) 
Wh 2076 LDD76 
12, 34642465 SBN65 Enough Samples, yet? 
i 6134 N ZF34 If not, go to cell 0047 
14 7500 EXF00 ; 
iS 2400 2400 Clear Enable 
16 2074 LDD7 4 Load Current Run No. 
7 4160 STI60 Store in cell 0133 
0020 2067 LDD67 Load Spare ID. . 
21 4161 STI61 Store in cell 0134 
22 2075 LDD75 Load Current Block No. 
23 4162 STI62 Store in cell 0135 
24 2073 LDD7 3 Load No. of Blocks/Run 
29 4163 STI63 Store in cell 0136 
26 7500 EXF00 ; 
27 bel bighadh Ze Call 163 M.T. U. 
0030 7203 OUTO3 Output from 
31 0000 C computed L. W.A. 
Sy, 6102 NZFO2 to ; 
33 0133 0133 0133 
34 2246 LDF 46 Set A-0137 ; 
35 4076 STD76 Reset running storage address 
36 2075 LDD75 Enough Blocks yet? 
a7 3473 SBD7 3 —_ 
0040 6155 NZF55 If not, go to cell 0115 
4] 0401 LDNO1 Ve 
42 4075 STD75 Reset block no. 
43 5455 AOD55 Update total black count 
44 3454 SBD54 Check if capacity exceeded 
45 SLs) S: NZF53 If not, go to cell 0120 
46 6061 ZJF61 If not, go to cell 0127 
___ 47. 5 476 AOD76 Begin intersample delay loop 
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Table I(b). Program Digitize. 








Cell Contents Code Explanations | 
0050 2066 LDD66 Load intersample delay word 
51 0701 SBNO1 If not zero, go back 1 
52 6501 NZBO1 If zero, go to cell 0005 
93 7056 JPIS6 0760-M.T.U. block capacity 
54 0760 0760 Total No. Blocks written 
55 0000 C Gy address 
56 0005 0005 address 
97 0003 0003 | 
0060 0133 0133 Address of Current Run No. ID 
61 0134 0134 Address of Spare ID of ID 
62 0135 OLS5 Address of Cur. .Block No. ID 
63 0136 0135 Address of Tot. Blocks ID 
64 0100 0100 Address of INITIAL 
65 C C Address of last word of data 
66 M M Intersample delay word 
67 M M Spare ID anything 
0070 M M Initial Run No. Set 1 
71 M M No. runs desired 
LD M M No. samples/block 76408 
IES: M M No. blocks/run , 
74 C C Current run no. . 
75 C C Current Block Number 
76 C C Running Storage Address 
Ftd C C JUMP CONTROL, 
0100 4077 STD77 BEGIN INITIAL 
101 2200 LDCO00 ; 
102 OlS7 0137 Set "A"-0137 
103 4076 STD76 Initialize running storage address 
104 3072 ADD72 Compute last address 
105 4031 STD31 Store in 0031 
106 0701 SBNO1 
107 4065 STD65 Store in 00695 
0110 2070 LDD70 i 
ve 4074 STD74 Initialize Run No. 
4 0401 LDNO1 ; 
i3 4075 STD75 Initalize Block No. 
14 7077 JP1I77 END INITIAL 
15 5475 AOD75 Update Current Block No. 
16 5455 AODS55 Update Current Block Count 
7 7057 PI57 Go to 0003 
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Table I(c). Program Digitize 


Cell Contents Code Explanations 
0120 2074 LDD74 Have enough runs 
21 3471 SBD71 been done yet? . 
22 6103 NZFO3 If no, go to 0125 

23 2074 LDD7 4 If yes, display last run no. 
24 7701 HLTO1 Halt 01 
25 5474 AOQD7 4 Update current run no. 
26 7057 JPI57 Go to 0003 
27 7500 EXF 00 Call E.O.F. : 
0130 WF 1111 Write an EOF Mark 
31 2055 LDD55 Load block count 
SZ 7702 HLT02 Halt 02 
33 C C RUN #ID 
34 C C SPARE #1ID 
ous: C C BLOCK #ID 
36 C C BLOCKS/RUN ID. 
0137 D D Data Storage 
5 D D 
ay 
27/6... ...D : D Data Storage 
Notes: 


1) Cis ENTRY PROGRAM COMPUTED 
M is MANUAL ENTRY 
D is DATA STORAGE 

2) CDC 1604 Identifier will appear as follows: ? 


Word 1 RUN # Spare Block #  . Blocks/RUN Format 016 





Word 2 Sample 1 Sample 2 Sample 3 Sample 4 


etc. 


Table II. Modifications to Digitize | 


Mod Gell # From To Se Pee 
1 0126 7057 7703 Individual blocks clocked at end 


of a run. To restart run at 0003 











2 0014 7500 0300 Initial block .clocked. Subsequent 
0015 2400 0300 blocks taken as fast as possible. 
0117 7057 7056 HLT in 0126. When run complete 
0126 7057 7703 reset FFI manually 

_s 0014 7500 0300 Initial block clocked. Subsequent 
0015 7500 0300 blocks taken.immediately. All 
0040 6155 6113 blocks have same ID. HLT when 
0126 7057 7703 run complete in 0126. FFI manual- 
ly reset. 
4 0013 6134 6506 Eliminates variable sampling delay. 


Samples possible in this mode 
every 120 sec. 
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Table III. Program TEST 160 


Note: M means Manual Entry 


Cell Contents Code Explanations 
0000 7500 EXF00 Begin Bias-set 
l 2410 2410 Set Enable 
2 7500 EXF00 r 
3 140] b4+0 (407 Call A/D Channel 1 
4 7600 INA Input to "A" in Reg. 
5 4070 STD70 Store "A" in 0070 
6 7500 EXF 00 . 
7 2401 2401 Call D/A Channel 1 
0010 7303 OUT03 Output Cell 0070 to 
11 0072 0072 Cell 0071 INC. : 
12 6102 NZFO2 
13 0070 0070 
14 0400 LDNOO Load zero's. 
15 4071 STD71 Store in 0071 
16 6414 ZJB14 Jump back to 0000 
17 7700 HLTOO HLT. End Bias-set 
0020 7500 EXF00 Begin Timer 
Pq 2410 2410 Set Enable ; 
22 7500 EXF00 CallA/D Ch. 1 . 
23 1401 1401 , 
24 7600 INA . 
23 4143 STI43 Store Sample in 0043 
26 0300 NOP No Operation-NOP 
2/ 0300 NOP These are Time 
0030 0300 NOP Dummies to 
Si) 0300 NOP Match Program DIGITIZE 
2 0300 NOP Timing 
33 0300 NOP 
34 0300 NOP 
30 0300 NOP 
36 2042 LDD42 Load Timing Control Word 
37 0701 SBNO1 Subtract 1 
0040 6501 NXBO1 If not zero, go back 1] 
41 7044 JP144 If is zero, jump,.to 0022 
42 M M Timing Control Word 
43 0043 0043 
44 0022 0022 
45 7701 HLTOQ1l End Timer 
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X Scale-20 units/inch.  Y¥ Seale- 2 unit/ineh. 
Pigure 7- 253 cps sc .are wave, & volts p-p. 200 usec. 
sampling. 





X Scale-20 units/inch,. ¥ Seale- 5 units/inch. 
Figure G- Auto-eorrelation of Figure 7 over 3900 samples. 
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X Seale- 20 units/inch.  Y Seale-1 unit/inch. 
Figure 9= 253 eps sawtooth wave, 1.8 volts p-p. 
200 usec. sampling. 
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A Seale- 20 units/inch. Y Scale#1 unit/indh, 


Figure 10- ‘uto-correlation of Figure 9 over 3900 
Bagnibgen 
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A Scale=- 20 units/inch. Y Scale= 1 unit/inch. 
Figure 1ll- 253 cps sine wave at 6 volts p-p. 
200 usee. saioiine. 


Gg = 





X Seale= 20 units/inch. Y Scale~ 2, unit/inch. 
Figure l2- Auto-correlation of Figure ll . 
3900 samples . 
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X Scale= 20 units/inch. Y Scale- 0.005 units/inch. 
Figure 13= rluctuations about the mean of a D.C. waves 
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RKlod= 4.74) X10 
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X Scale~ 20 units/inch. Y Scale= 2x10 units/inch. 
Figure ite Autoscorrelatioen ef Figure 13. 
3900 samples . 
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X Scale- 20 units/inch. Y Scale- 1 unit/inch. 
Figure 15- Noise generator band-limited at 30 cps. 
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Fdb. corace frequency OF KYK FISTER 13 47.5 <pew. 


X Bcale- 20 untts/ingh. ¥ Scaie- 1 unit/inch. 
Figure 16- Auto-co-relation of Figure 15. 
3900 samoles . 
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. X Seale- 20 units/inch. Y Scale- 2 units/inch, 
Figure 17- Noise generator output. 200 usec, sampling. 
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X Scale- 20 units/inch. Y Scale= 1 unit/inch. 


Ti pune ioe Aute=eenreiatien ef Ficure 17: 
3900 samples . 
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APPENDIX B 
NOISE REMOVAL IN CORRELATION, 


USING A PRIORI KNOWLEDGE OF NOISE 


Assume that as apriori information we are given-the expected form of 
the interfering noise, represented by a normalized correlation function 
Ranke T) formed in the absence of signal. We asgpme that when the re- 
ceived signal is corrupted by noise, the statistics of the received noise are 
described by this priori knowledge. Specification of the statistics of the 
noise by the correlation function implies that the noise distribution is ad- 
equately described by only it's first two moments. We shall assume that 
the observed date is of mean Zero. 

Knowing the noise, it was shown that under cegtain assumptions we 


¥ 


could write 


iA Az A+. +! 


where re in(k 41) is the observed normalized correlator output 
Rg (k 4 T) is to be determined. | 
Re ark 4 T) is known apriori 
Obviously we must determine % before Rgg(k 47) may be determined. 
Since the correlator produces a correlation function the author's first thoughts 
were to find & using the observed and known correlation functions. 
In the general case, the form of the correlation function of the signal 


is not know. For the class of input signals having a non-periodic correlation 


1 


ad 


function, any choice of « which forces the output to be periodic, ie max 


‘+0 
R= R(0), would be fallacious. 


Therefore we shall only consider the class of signals having periodic 
correlation functions. 


Let us consider the function 
ht A 
F(«) = 4(Rgan(0) -@R%qy(0)) - Max (2) 
TSO 


which may be written 





Roe (1) ~ & REN (T) 





"= 
FH ) = Max ia Rasy - Raut] f 3) 
Since the functional forms of Rg an(T) and RF ny T).are not known explicitly 
no further analytic evaluation can be made of F(® ). 

Certain features of F(%) are known however in the case of periodic cor- 
relation function. If F(*) < 0, then % is too large, and the output is not 
a valid correlation function since R( 7 + 0) > R(T =0). If F(%) > O, not 
enough of the noise correlation has been subtracted, and the output will be 
excessively noisy for small T. 

The best choice of “% would then seem to be & , such that F(X ¥) = 0. 


The determination of & ¢ must be done iteratively since no explicit 


analytic formulation: for the function. is known. 
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Consider Figure 1 below 





+ 
Initially set Xp = Q, O~— I, and &; = Spa 
Evaluate F(% ) and decide 
a) te Se if F(%,) 7 0 
= x 
by xX =o, HE AM << 
c) Terminate if [F(a | LE 


a. “ain Xn ye? 


Then Xx i+] ; 


ln 
Having found %,, such that - Es F(X P) <S +€ the portion of Ryy ‘T) due 
to signal may be estimated by substitution in Eq. (1), that is 

nN a is | 

Rgg(T) = Rn (T) - Ae Ryn l 7) (4) 

At this point we have a combinational ratio which causes a periodic out- 

put. However there is no guarantee that the new correlation function formed 
in Eq. (4) is the result of a physically realizable linear system. This is be- 
al 


cause the condition that the correlation be no larger for any other than 


T = 0 is a necessary condition and not a sufficient condition. A sufficient 
condition for realizability is that its transform, the power spectral density, 


have no negative portions. 


a 


Rather than attempting to determine & in the correlation domain, it is 
more fruitful to do a similar search in the frequency domain. The obvious 
advantage is that physical realizability is easily satisfied. 

Transforming Eq. (1) we have 

Pog(k 45 ) = Pa, (kas ) - & PR (kas ) (S) 
where the asterick indicates normalization. 

An iterative search, similar to the previous search, results in determina- 
tion of &% , subject to physical realizability constraints. 

This is ensured by terminating the search when for any k, the value of 
Eq. (5) is less than .00001. 

If any value greater than this is used then the contribution will be neg- 
ative and realizability is violated. Ifa smaller value is used, more noise 
will be left than in the case X% =% |. 
This value of & = & . was then used in Eq. (5) and in Eq. (1). 


The results of Eq. (5) were renormalized to have unity area by the trap- 


ezoidal rule, that is 


L-1 
+ (kp; + kp;) + 2 = kp) = 1 (6) 
from which we have 
L-l ‘ 
k = 2/(pp+pp+4 ZB py) (7) 
2 


AN 
The results of Eq. (1) were renormalized by a factor 1/:Rgg(0Q). 
To evaluate the results assume that the correlation of the desired signal 


wend 
formed in the absence of noise Rgg(k4 T) is available for comparison. 
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An estimate of the noise power in the correlatdr’output may be found by 


+ 


evaluating 


K A A) 
No = — = ( Rog (k 4 T) -(l-« FS) Rog (k A a (8) 


The signal power in the correlator output may be evaluated several ways. 
One method is to assume that the scaled version of the pure signal, (1 -~ ). 
Rog( T = 0), represents the peak value of the periodic output. In the case 
of a single sinusoid signal, the output power would be given by ((1 -« ) > 
Rgg(0))2/2. 

The input signal-to-noise power ratio may sae6 be determined in several 
ways. One method is to compare the variance of the noise with that of signal 
plus noise to give 


S/Mnypur = Sun - Sy 1/4 x | (9) 


An alternate method to determine S/N ratios and processing gains achieved 
is via the normalized power spectral density, obtained from the transform of 
the correlation function. This method is felt to be more accurate than deter- 
minations made from the correlation function because of the difficulties 
encountered in separating the signal components of.a correlation function 
from the noise components. 

Determination of signal to noise ratio from the normalized power spect- 
ral density proceeds as follows. 

The energy under the normalized density curve, with respect to a unit 


change of index i, is given by 
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+] : 
a Pegi =] (10) 


] 


Using the trapezoidal rule we may evaluate this as 
Kn M 
1 
B= > &+Xyyj) + 2 2 X% + X%y = lee (11) 


i=2 
iXS 


where Ko is the component due to the signal. 
The desired output, Y, is given in terms of frequency rather than unit 
change of index and is given by 
Y= kX,/ 7 (12) 


where k = 24tM 


AF = ee 


At interval between samples in seconds 
M = the number of frequency estimates ., 


Substitution of Eq. (12) in Eq. (il) yields - 


fe 
Ev= Nes (13) 
M 
where NW = = &) +Xyey) +2 ee X} | 
i=2 
ixS 


Aw 
S = 2EY, af 


The ratio of energy due to signal S, to that of noise, N is 





S = Jens =a a Se (14) 
N E=-2EY, L = 2 epee Cade 


or in decibels 


(S/N)db = 10 logj9 (S/N) (15) 
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2. Comparison of Auto and Cross-Correlation 

No method of processing can improve the processing gain given by cross- 
correlation, which is taken to mean comparison of a signal plus noise with 
the completely specified input signal. This fact arises because of the a- 
prioris information assumed to be available. 

When in general the desired signal is not known, auto-correlation, that 
is comparison of a waveshape with a time shifted replica of itself, may allow 
detection of the signal. In no case does it do it as efficiently as cross- 
correlation with an uncorrupted signal. 

If the noise can be assumed to be completely specified by it's correla- 
tion function, then it seems reasonable to assume that results approaching 
that of cross-correlation might be obtained by suitable removal of the known 
noise effects. 

Lee [1] has developed models to estimate the processing gains possible 
for both auto and cross correlation, for the case of a single sinusoid ,z, 
Emsin(wt+ Q@) corrupted by noise of zero mean and variances 5 

For a single sinusoid input the desired output of the correlator Rgg (7) = 
E2 cos w/t where E= Em/ V2. 

At the input to the auto-correlator, let N; be the input noise in rms 


value, and let 


ne G 
Pi = ee n 
i = S; E (16) 


be the input noise-to-signal ratio. This definition while not conventional 








leads to compact formulation. 
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: 
j 


The output noise in rms: value may be shown[( 1] to be 


7 4 ag # ae 
Nog = Fr (5 + 2E-ge + #{ (17) 


where N is the number of data samples considered... For.sinusoidal input, :the 
rms signal output upwi 
So, = E4/ V2 (18) 


At the output of the correlator the signal to noise ratio Ro is given by 





a 
™ Soa 
Substitution of Eg. (13), (14) and (15) into Eq. (16) yields 
N 
R = 101lo =a le, oa 20 
ue sill a Sh aa iq 


If in the case of cross-correlation we assume the signal plus noise is 
correlated with a local signal Em sin w ty the outhEt noise in rms value . 


may be shown to be (1). 


1/2 
Noc = Fr S + £2 6, ‘ (21) 


and the output signal rms. 





Zi 
V Z 
The gain in db, Rog, is given by sli 
Soc 
Rog = 20 log) yo db (23) 
4 
This may be written using Eq. (16) 
ee ee eee (2.4) 
1+ Die 


r- 


Inspection of Eq. (20) and Eq. (24) clearly shows the superiority of 


cross-correlation especially for large Pj (ie weak signals). 
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The superiority is expressed by the difference 


eA is a2 
= 10 logy, shit SS ee i (25) 


Coase cui. 1+29 j2 


0a 


The concept of processing gain is perhaps more useful for comparison 


of any proposed method with these two standard methods. 


Let us define processing gain as the difference in signal to noise ratio 


at the output and the input of the processor. 
EZ 


N ¢,? N 
MUON CS | ers, oS LOE) (26) 
D+ 4p yr +294 mn 4+ 23; 
: 
and Gpc = ae - 10 logig = db 
"~ 
N § ,;2 : 
= l0log di 2 = 10 logig = (27) 
Le yo 


~ 


Finally the difference in processing gains a 


Dac = Gpa - Gpa = 10 logyg (2 +f ;2) db (28) 
The above forms are quite accurate for £ ;73. However the quantity 
Si = a ims is not the most commonly used description of signal to noise 
ratio. Accordingly equations (26) and (27) have been recast in terms of in- 
put signal to noise power ratios in db, and plotted in Figure 2. Eq. (28) 
was similarly treated and is shown in Figure 3. 


Figure 3 conveniently shows the extent to which auto-correlation proces- 


sing is able to emulate cross-correlation processing. 
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Figure 2: FRocessing Gan vs. SNR 
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Figures 2 and 3 are for 3750 samples. 
3. Experimental Results 

The results obtained for the case of unity signal to noise ratio are ex- 
cellent, as may be seen by comparing Figures 5and10. Figure 5 is the 
power spectral density of a sine wave formed without noise. Figure 11 is 
the power spectral density of the 0 db signal to noise ratio input after the 
noise has been removed. A processing gain of 26 db was attained, as com- 
puted from the correlation function. This is iar between the performance 
of an auto-correlator and a cross-correlator. 

Since results were so encouraging, the -10 db signal to noise case was 
then considered. Several problems became evident that previously were mask- 
ed by the strong signal component. 

Determination of ~ becomes difficult at low signal-to-noise ratios due 
to the small signal component in the auto-correlation function, and led to 
the formation of physically unrealizeable correlation functions, as evidenced 
in Figures 13, 14 and15. Inspection of Figure te, ate power spectral den- 
sity of the -10 db signal plus noise before noise removal, shows a strong 
component near 50 cps. It's transform, the correlation function (not shown) 
is difficult to interpret. 

This suggests that the signal-to-noise ratio measure of quality may not 
be the most meaningful for this type of signal detection. 

A more meaningful measure is the ability to distinguish a signal com- 


ponent in the power spectral density from a large noise spike. This ability 
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may be expressed in dbas 





A = 10 lodig fori & s (29) 


Xx Yi 

If A is computed before and after noise removal, the increase inAisa 
direct measure of increased gain. 

In other words, at low signal-to-noise ratios the problem shifts from 
one of interpreting a correlation function, to that of evaluation of the psd. 

During the course of experiment it became evident that the spectrum of 
the noise may vary quite considerably from block to block. Since it was 
desired to remove the expected noise spectral density, more than a single 
block of noise must be used. By averaging the correlation function of noise 
over ten blocks much smoother spectra resulted (Figures 6, 7 and 8). The 
average noise correlation over ten blocks was used for the -10 db case. 
This of course implies stationarity over the period of time represented by 10 
blocks of noise. 

The claim that averaging separately formed correlation functions is 
equivelent to an increase in integration time, when_the process is ergodic, 
should be verified. Examination of Eq. (26) and Eq. (27) leads to the con- 


clusion that G,. should increase by 3db when the fumber of samples is 


pa 


doubled, ie 
N 
mel. 
T (30) 
where N] and N are the number of samples used. 
This goal was not reached, but was closely approached, falling short 


LA Gpa=10 logig 


by about 1 to 1.5 db. 


The results obtained for the -10 db signal to noise ratio input are shown 
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ton, 


in Figures 17 and 19, before noise removal, and in Figures 20 and 21 after 
noise removal. Noise removal had the effect equivalent to increasing the 


input signal to noise ratio by 14.46 db. Discrimination against mise peaks 


was increased by 3.42 db. 
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X Scale- 0.02 units/inch. Y Scale- 100 eps/inch, 

Figure 10- Power spectral density of ODB. sirnal after 
noise removal. Alpha calculated on RBAR(T). 
3750 samples . 
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Figure 17- -10DB. auto-correlation before noise 
removal. 22500 samples. 
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Figure 18- Estimated auto-correlation of noise in ~10DB. 
signal plus noise input, averaged over 
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APPENDIX © 


DETECTION AND LOCATION OF SIGNALS IN NOISE 


In Appendix A and B methods were developed for digital analysis of 
analogue signals. 

The data utilized in the above appendices was ina sense artificial, in 
as much as it was generated in the laboratory. 

To test the proceedures developed using a live signal, where signal 
characteristics and noise statistics are generally not known, a 200 cps 
sinusoidal signal source was placed in an unknown. .noise field produced by 
patrons, of a cafeteria. 

The signal source was set up at one end of the dining room, and its' 
volumn raised until complaints were voiced. The source level was then 
lowered until the complaints ceased. This level, which we shall refer to as 
the 0 db level was measured to be 38 milliwatts at.the volce coil of the loud- 
speaker. At this level the sound was occasionally audible at various loca- 
tions within the room, but was not detectable aurally at the microphones. 

A stereo recorder was set up at the far end of the room, using two micro- 
phones symmetrically placed about the longtitudinal center line of the room. 

A number of three minute recordings were made of signal plus noise, re- 
duced signal plus noise (-9.3 db), and noise alone. 

The noise level of the crowd varied very considerably over the hour and 
was punctuated by an occasional dropping plate. The period from 12:30 to 


12:40 was selected for further study as the number of diners was essentially 
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constant over this period. The details are listed in Table I. 

By cross-correlating the left and right channel information it is possible 
to locate the source and to estimate its. frequency.. 

The bearing of a source, with respect to the center-line may be deter- 
mined by measurement of the difference in arrival times of sound waves at 
the receiving sensors. 

Assume as in Figure 1, a distant sinusoidal source, at.aniangle 8 mea- 
sured from the center-line or dead-ahead position, and two sensors symmet- 
rically placed about the center-line spaced d units apart. 

Assuming plane wave propagation, with no multipath effects, and in the 
absence of noise, the difference in travel time or phase of ray 2 is a direct 


measure of the angle @. 





MZ : 
Mi 

h— qd ——— : 
Figure 1. (a) The basic DF Problem. (b) Cross-Correlation of My, Mo. 


j 142 
Forming Ruy’ My Ce SI ih, Ses a J | (cos wot)(cos Wolt-T)) dt 


(1) 
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W 


WwW O ; 
Ruim2'T) = ae - Tw, 4 [cos LV Pitogs® Woe Ts +(%) at 
TV 
Wo /Wo _ 
tee wiles cos | Wg 1 - y [at (2) 
Ruima(T) = 0 + cos (WoT -»x) (3) 


The first peak in the correlation curve occurs when 


x eS 2 ae 
WoT, =% or Pn end sin 0 (4) 


Subsequent peaks in RyyimM2 (7) occur when 


WoT -Y =N(2T) , N=0,18, 3... 

Peaks obtained for n & 0 represent ambiguities in the bearing angle. The 
first ambiguity occurs when T p = - sin 4 @ or 46=6, - 6= sin7} ae 
a ae C2 

d Wo 


The first peak at T is of interest. In this case using room measure- 
ments and an assumed velocity of propogation of 1129 ft/second, 7, was 
calculated to be 1.5506 msec. for an angle of 10.4°. For small angles we 
may assume the time and the associated angle are linearly related. Under 
this assumption the arrival time would change very nearly 150 BR sec. per 
degree. 

The available processing system however could.sample the record at 
best every 200 i sec., resulting in a bearing accuracy of about 1.339. To 
improve the bearing accuracy, the data was slowed by a factor of four, 


grequency shifting all components down by a factor of four. This has the 
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effect of increasing the arrival time by a factor of four resulting in a bearing 
accuracy of 1.33/4° or . 333°. 

The mechanics of the speed reduction are shown in Table 2. 

This is more bearing accuracy than is justifiable but since a reduction 
in data speed of at least two was necessary to digitize, a 5 Ke analogue re- 
cord, the extra factor of two was used to increase bearing accuracy. 

The data speed reduction meant that the original.200 cps signal would 
appear as 50 cps with the first peak of the cross-correlation curve at T = 
6.02 msec. The data was sampled at intervals of 205 pi sec. , and hence 
the signal, if present, should occur between 29 and 30 shifts of the correla- 
tion function argument. 

2. Data Analysis 

Twenty blocks of data were digitized for each of three cases; signal to 
noise ratio 0 db; -10 db; and noise alone. 

Due to difficulties experienced with the clocking system, only the first 
block of a twenty block run was clocked, with clocking of subsequent blocks 
internally. Due to the variations in the time necessary for the 163 tape unit. 
to recover from a writing operation, € cumulative error in clocking arose: 
Hence only the first few blocks are time synchronized to an acceptable degree. 
pornately this was long enough for sucessful signal detection. 

The data was normalized in the computer by the computed estimator of the 
standard deveation, and the cross-correlation of the normalized data formed. 


The time of integration was fixed due to the finite block length. Assum- 
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ing a process is stationary and ergodic, (at least short-time stationary) the 


effective integration time may be extended by averaging in time, ie 


N 
if Rap(T) = = 2 Fal $t-T) (5) 
- K 
and =s- Riab(T) = = Z Rab (1) 
eee 
_ i K 1 N 
Ra(T) = — Bi ZFS t-1) 
i=] N=] 
1 NK 
— z $a(T) 5,0 -7) (6) 


The running average cross-correlation function of the 0 db signal plus 
noise was formed over the first five blocks and is shown in Figures 3 through 
5 asa "“hatched-in" curve. 

3. Results 

Experiments with averaging more than five curves were not successful, 
due to the previously mentioned cumulative timing error. 

The cross-correlation of 0 db signal plus noise was abserved to be es- 
sentially sinusoidal with the first peak occuring between 29 and 30 shifts 
exactly as predicted. 

The frequency of the sinusoid however was observed to be 150 cps, or 
three times the expected signal frequency, indicating detection was being 
made on the third harmonic of the source! 


No firm explanation for this is offered. However it is noted that the 
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oscillator produced 0.1% third hormonic, and the 20 W. push-pull amplifier 
used would be expected to produce considerable cross-over distorion when 
operated at such low power levels. In addition the tape re-recording process 
tended to favour the upper registers. 

A power spectral density was made of the 0 db signal plus noise, and 
of noise alone, using a 6.125 cps filter bandwidth., The normalized results, 
shown in Figure 2, reveal the pronounced 150 cps component in the signal 
recording, with the general shape of the remaining portion being similar to 
the noise power spectral density. 


The programming mecessary is included as Program SIMSIG in Appendix 


The results obtained with the signal at -9.3 db were inconclusive and 
are not included. 
4. Conclusion 

Provided accurate time synchronization between right and left channels 
can be maintained during the digitizing process, cross~-correlation of the two 
channels provides both bearing and frequency information. 

The process of averaging cross-correlation curves must be done with 
care, ensuring accurate time synchronization and continuing the averaging 


process only as long as the signal characteristics remain stable. 
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ANALOGUE DATA DIGITAL 
TIME Sloan RUN 
12:30-12:33 ne DB. E 0001 0021 0001 0024 (R) 
TO 
0001 0021 0024 0024 
0001 0032 0001 0024 (L) 
TO 
0001 0032 0024 0024 
12:35-12:33 "-10"DB. J 0002 0021 0001 0024 (R) 
TO 
0002 0021 0024 0024 
0002 0032 0001 0024 (L) 
TO 
0002 0032 0024 0024 
12:41-12:44 NOISE c 0003 0021 0001 0024 (R) 
TO 
Digitized on Reserve Tape 18 0003 0021 0024 0024 
Sampling Interval 205 Ms. 
0003 0032 0001 0024 (L) 
TO 
0003 0032 0024 0024 
TABLE I: Details of Data Digitized. 
STEP PLAY BACK BAN D-W. RECORD BAN D-W, SIGNAL 
Concertone 590 cps Ampex FR-100 O0O-1.1 Kc. 200 
7 Sei 10 he cps 
Ampex 0 - 650 cps Concertone 20 - 650 100 
7 SebPS 7.5 IPS cps cps 
Concertone 10 - 325 cps Ampex L.Oe=o 75 50 
3.7 oO Leo 7.5 IPS cps cps 
TABLE II: Frequency Reduction Process. 
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